When something comes down, it loses the kinetic energy that put it up. You are right, fiberglass mat was used to keep the ablative material together. It would vaporize, sacrificing itself while carrying heat away from the capsule. it is thought the Apollo astronauts had a high rate of cancer, but the quantitative sample total is too small to get real stats...we would certainly know if folks stayed there. Long term damage may prohibit it.